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Abstract- Generating fuzzy rules from training data is the 
most vital assignment in design of fuzzy classification system. 
In this paper, we present an approach to deal with the 
classification problem where fuzzy logic is used. We intend to 
show that fuzzy logic introduces new elements in the 
identification process, to manage imprecise information. A 
method to generate set of definitive fuzzy rules from initial 
training data is introduced. A triangular membership 
function is used for generating fuzzy rules from training data 
as they are simpler and more human understandable with 
high interpretability. 

I. INTRODUCTION 

The fuzzy classification system is one of the important 
applications of fuzzy set theory [11]. We proposed a procedure 
for generating fuzzy rules from input dataset and then to 
construct a set of definitive rules that are generalizations of 
initial rules. Fuzzy rules are used for knowledge representation. 
Two methodologies to get hold of fuzzy rules for fuzzy 
classification systems. One is given directly by experts; and the 
other is produced through an automatic learning process. The 
main purpose of this paper is to obtain an automatic procedure 
able to get the structure of a fuzzy rule from a given input 
dataset. Fuzzy rules generated must contain fewer components 
in the antecedent clause of the rule and identifying 
simultaneously the largest number of examples in given input 
data set. 

In recent years, some methods as in [4] have been presented 
to generate fuzzy rules from training data. As in [7], Castro et al, 
anticipated a method for learning maximal structure rules for 
dealing with the Iris data classification problem. As in [5] 
Chang et al, presented a scheme to generate fuzzy rules from 
numerical data based on the elimination of attribute terms for 
dealing with the Iris data classification problem. As in [6] Chen 
et al offered a method for constructing fuzzy decision trees and 
generating fuzzy classification rules from training dataset. 

As in [9] Kasabov, presented method for learning fuzzy rules 
and approximate reasoning in fuzzy neural networks and hybrid 
systems. As in [10] Hayushi et al., anticipated a fuzzy neural 
expert system with automated extraction of fuzzy if-then rules 
from a trained neural network. As in [8] Nozaki et al, presented 
a heuristic method for generating fuzzy rules from numerical 
sets. 

In this paper, we present a new method to generate fuzzy 
rules from a set of training data to deal with the Glass data 
classification problem. First, we convert the training data into 

initial fuzzy rules, and then we merge these initial fuzzy rules in 
order to reduce the number of initial fuzzy rules. Eventually we 



will get set of definitive fuzzy rule from initial fuzzy rules using 
different operations like merging, amplification etc. The rest of 
this paper is organized as follows. 

In Section II, we briefly describe a fuzzy rule-based 
classification [1]. In Section III, present a new method for 
generating fuzzy rules from training data. In Section IV an 
example to illustrate the proposed method. The conclusion is 
discussed in Section V. 

II. FUZZY RULE-BASED CLASSIFICATION 

Fuzzy rules are simply IF-THEN rules, used for knowledge 
representation with high interpretability [1]. For a pattern 
classification problem, Fuzzy IF-THEN rules include two 
clauses viz. antecedent and consequent. Antecedent clause 
includes conditions for the occurrence of the event; while 
consequent contain consequence of antecedent clause. 

For generating fuzzy rules we need to draw membership 
function for corresponding input data. The length of 
membership function is obtained using the difference between 
maximum and minimum value of the attribute. Membership 
function rescaled each input attribute to unit interval [0, 1] by 
using linear transformation that preserves the distribution of 
training patterns. Then, partitioning the pattern into fuzzy 
subspaces took place where each subspace is identified by a 
fuzzy rule. By assigning linguistic values of each input attribute 
we can do partitioning. Generally, triangular membership 
functions are used for this purpose, as they are simpler and 
more human understandable with high interpretability [1]. 

Fig. 1 shows membership functions for four different values of 
K, where L3, L4 and L5 are the linguistic labels, which 
interprets linguistic values small, medium, and large, 
respectively. 
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Fig. 1. Different partitioning of each input attributes [1]. 

Now, consider there are four fuzzy rules: 

If xl is small and xl is small then Class 1 (I) 

If xl is small and xl is large then Class 2 (II) 

If xl is large and xl is small then Class 3 (Ill) 

If xl is large and xl is large then Class 4 (IV) 
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When fuzzy rule-based systems are used for two- 
dimensional problems, generated fuzzy rule [3] from above 
equations is shown in figure2. Where triangular membership 
function defines small and large linguistic values. It is an 
example of a fuzzy rule table for a two-dimensional pattern 
classification problem. 
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Fig 2. Four fuzzy rules in two-dimensional pattern [0, 1] x [0, 1]. 
Fuzzy IF-THEN rules for a pattern classification problem for n 
attributes can be written as follows [1]: 
Rule Rj: IF xl is Aji and . . . and xn is Ajn 

THEN class Cj, forj=l,N (1) 
Where X = [xl,x2,xn] 

= ^-dimensional pattern vector, 
Aji = Antecedent linguistic value of Rj, 
Cj = Consequent class, 
N = Number of fuzzy rules. 
Generally, for an M-class problem with m labeled patterns 
Xp = [xp 1 , xp 2 , . . . , xpn ],where p = 1, . . . ,m, our task is to 
design the classifier to generate N fuzzy rules as in (1). Using 
training pattern in the corresponding fuzzy subspace consequent 
class Cj of the fuzzy rule Rj in (1) can be determined. The 
compatibility grade of the training pattern Xp is defined with the 
antecedent part of the rule, by the usage of the product operator 
as 



(2) 



Where juji (.) is the membership function of the antecedent fuzzy 
set Aji .Using heuristic method which is based on confidence we 
select the consequent class of a rule [4]. This confidence is 
given as 



conf(Aj ClassT} = 



W<- X P> (3) 



Hence from (3), the consequent class Cj is determined using the 
maximum confidence, shown using (4). 

Cj = argmax{conf(Aj =^> classT)\T = 1,....,M} (4) 

III. GENERATING FUZZY RULES FROM 
TRAINING DATA 

Our Here, we present a new algorithm to generate fuzzy rules 
from training data to deal with the Glass data [10] classification 
problem, where we deal with data are multiple input and single 
output data (MISO). Take for granted that there are m instances 
(i.e. al, al, am) of data to be trained. Assume that the ith 
training data ai has n input values and one output value, shown 
as follows: 

a i= ((Xi! x i2 , xin), yi) 



Where xij is the jth input value of input variable Xj of the ith 
training data ai, and xij is a real number; yi is the value of output 
variable Y of the ith training data, where i = 1, 2, . . ., m and j = 
1,2, ...,n. 

Let / be a set of initial rules. We can convert the initial 
training data into fuzzy rules one to one and put them into the 
set of initial rules [8]. It can be done in following manner. 
Apply linguistic label to each input training data, which further 
represents a membership function. First, we get an initial 
training data ai which is not converted yet. Then, we get the jth 
input value of ai, denoted by xij, which is not converted. 
Assume that the domain of input variable Xj was divided into z 
equal parts. If z = 7, we can define 7 labels, as shown in Figure 
3, where each label represents a membership function. 




Fig 3. Membership functions of the corresponding labels. 

Then, we estimate membership value by mapping xij into 
every membership function as in Figure 3. We compare all of 
the membership values, take the label which has the maximal 
membership value, and replace the numerical value xij by that 
label. The same procedure is repeated for getting all labels. 
Then, we can get a fuzzy rule which is converted from xi, and 
we put this rule into the set of initial fuzzy rules. After this step, 
we take another initial training data item which is not labeled, 
repeat the step described above until the all of the training data 
are converted into fuzzy rules and these fuzzy rules are put into 
the set of initial rules. 

Then, we deal with the fuzzy rules converted from the 
initial training data set. First, we take a fuzzy rule R from the set 
of initial rules. If the set of definitive rules is empty, then we let 
the fuzzy rule R be a member of the set of definitive rules; if the 
set of definitive rules is not empty, then we take one fuzzy rule 
R ' which has the same output as the fuzzy rule R and merge it 
with the fuzzy rule R [2]. The action of merging is defined as 
follows. 

Definition 1: Assume that fuzzy rule Rj = ((L0, LI, Ln), 
yi) and fuzzy rule R 2 = ((X '0, L'\,L n), yj). Then, fuzzy rule Ri 
and R 2 are merged into fuzzy rule R 3 , where R 3 = ((L"0, L"\, 
L"n), yk), if and only if yi = yj. Then L"0 = LOUZ/0, L"l = 
LlULl, and L"n = LnUZ n, and yk = yi = yj, where "U"is the 
union operator. 

Example 1: Assume that fuzzy rules P and Q are merged 
into fuzzy rule R, where P = (({L0, L5}, {L3}, { L0, L4, L2, 
L6}, {LI}), 1), Q = (({L2, L3, L6}, {L3}, {L5 , L6}, {LI, L3, 
L4}), 1), then R = (({L0, L2, L3, L5, L6}, {L3 }, {L0, L2, L4, 
L5,L6}, {L1,L3,L4}), 1). 

Definition 2: Assume that fuzzy rules P = ((L0, LI, Ln), 
yi) and Q = ((L'0, L'l, L'n), yj). Then, fuzzy rules P and Q are 
in collision, if and only if yi ^ yj, LOHL'Oi^y/, LlHL'l^y/, and 
LnHL n ±y/, where yj denotes the empty set. 

Definition 3: The merge of fuzzy rules P and Q into 
fuzzy rule R is allowed, if and only if fuzzy rule C does not 
collide with any of the fuzzy rules which are in the set of initial 
rules. 
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If merge of fuzzy rules R with R' is allowed, then the 
fuzzy rule R is merged with R ' into fuzzy rule R and we use 
fuzzy rule R " to replace R ' which is in the set of definitive rules 
[2]. If the merge of fuzzy rules R with R' is not allowed, then 
take another fuzzy rule which was not taken before and have the 
same output with fuzzy rule R and repeat the process described 
above. If the fuzzy rule R can't merge with any fuzzy rules in 
the set of definitive rules, then the fuzzy rule R becomes a new 
member of the set of definitive rules. Repeat those processes 
until all of the fuzzy rules in the set of initial rules. 

In this way, we present an algorithm to generate 
definitive fuzzy rules from a set of training data. [8] 

Step 1 : While do examples exist in the set of examples 
Do: To convert the example into an initial rule. 
Step 2: To take an initial rule from the set of initial rules. 
Step 3: To prove if it subsumes in some rule of the set of 

definitive rules. If it subsumes, go to step 2. 
Step 4: For each variable in the initial rule: 
Step 4.1: For each label not considered 
Step 4.1.1: To prove if it is possible to amplify the 
rule. If it is not possible, go to Step 4.1 
Step 4.1.2: To amplify the rule. 

Step 5: If there are rules in the set of initial rules, still not 
considered, go to step 2. 
Or else END. 
IV. EXAMPLE 

In this section, we apply proposed a new method to generate 
fuzzy rules from training data to deal with the Glass dataset [2] 
classification problem. The Glass data contain 214 instances. 
There are six species of the Glass data and nine inputs attributes 
as shown in Table 2 and Table 3 respectively. 



TABLE 2. OUTPUT VALUES OF THE OUTPUT ATTRIBUTES. 



Type 


Output Classes 


1 


Building_windows_float_processed 


2 


Building_windows_non_float_processed 


3 


Vehicle_windows_float_processed 


4 


Containers 


5 


Tableware 


6 


Headlamps 



TABLE 3. THE CHARACTERISTICS OF INPUT ATTRIBUTES OF THE 
GLASS DATA. 



Input Attributes 


Min. Value 


Max. Value 


Refractive Index (RI) 


1.5112 


1.5339 


Sodium (Na) 


10.73 


17.38 


Magnesium (Mg) 





4.49 


Aluminum (Al) 


0.29 


3.5 


Silicon (Si) 


69.81 


75.41 


Potassium (K) 





6.21 


Calcium (Ca) 


5.43 


16.19 


Barium (Br) 





3.15 


Iron (Fe) 





0.51 



In order to clearly illustrate the proposed fuzzy rules 
generation algorithm [8], We assume that the number of labels 
for each input attribute is 7, i.e., L0, LI, L2, L3, L4, L5, L6, L7. 
Here maximum and minimum values for refractive index 
attribute are 1.5339 and 1.5112 respectively. Hence we plot one 
membership function shown in fig. 4. 



L0 Ll L2 L3 L4 L5 L6 




1.5112 1-514 1.5168 1.5196 1.5224 1.5252 1.528 1.5308 1-5336 

Fig 4. Membership functions of the input attribute. 

Similarly we can plot membership function for all remain 
attributes. Here; we only chose 12 instances from the Glass data 
for illustration, where 2 instances of each species are chosen. 
The chosen instances for this example are shown in Table 4. 
Then, we consider fuzzy rules sequentially from the set of initial 
rules as in Table 5 and perform the merging process. 

Finally, we can get a set of definitive fuzzy rules from the set of 
initial rules. There are 6 fuzzy rules in the set of definitive rules, 
shown as follows: 

R0: (({L0}, {Ll, L2}, {L2}, {L5, L6}, {Ll}, {Ll, L3}, {L0}, 
{Ll}, 

{L0}), 1), 

Rl: (({L0}, {L0}, {L0}, {L0}, {L0}, {L0}, {L0}, {L0}, {L0}), 

2), 

7?2:({L1},{L0,L1},{L2,L3},{L5},{L1,L2},{L2},{L0},{L0, 
L1},{L0}), 3), 

R3: (({L4}, {L2}, {L2}, {L5}, {Ll}, {L3}, {L0}, {Ll}, {L0}), 
4), 

7?4:(({L4},{L0,L1},{L1,L2},{L2,L3},{L2,L6},{L0,L3},{L0, 

Ll}, {L0, L2}, {L0,L4}), 5), 
7?5:(({L5},{L2},{L1},{L0,L2},{L2,L3},{L2,L3},{L0},{L2, 

L3},{L0}), 6), 

V.CONCLUSSION 

In this paper, we have presented a new method to generate 
fuzzy rules from training data to deal with the Glass data 
classification problem. Set of definitive rules is generated from 
initial fuzzy rules. Fuzzy rules used for knowledge 
representation. Using Fuzzy IF-THEN rules high 
interpretability for pattern classification can be achieved. Using 
triangular membership function accurate fuzzy rules can be 
obtained. 
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TABLE 4. INITIAL TRAINING DATA. 
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19 
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J) 


1.5185 


13.64 


3.87 


1.27 


71.96 


0.54 


8.32 





0.32 


3 


1.5177 


13.65 


3.66 


1.11 


72.77 


0.11 


8.6 








4 


1.5161 


13.33 


3.53 


1.34 


72.67 


0.56 


8.33 








4 


1.5151 


14.01 


2.68 


3.5 


69.89 


1.68 


5.87 


2.20 





5 


1.5192 


12.73 


1.85 


1.86 


72.69 


0.6 


10.09 








5 


1.5206 


12.85 


1.61 


2.17 


72.18 


0.76 


9.7 


0.24 


0.51 


6 


1.5212 


12.97 


0.33 


1.51 


73.39 


0.13 


11.27 





0.28 


6 



TABLE 5. FUZZY RULES IN THE SET OF INITIAL RULES. 



Initial Fuzzy Rules 


Initial Fuzzy Rules 


(({L0} , {L2} , {L2} , {L6} , {L 1} , {L 1} , {L0} , {L 1} , 
{L0}),1) 


(({L4} , {L 1} , {L2} , {L5} , {LI} , {L3} , {LO} , {LI} 
, {L0}),4) 


(({L0} , {L 1} , {L2} , {L5} , {L 1} , {L3} , {L0} , {L 1} , 
{L0}),1) 


(({L4} , {L 1} , {L2} , {L5} , {L 1} , {L3} , {LO} , {LI} 
,{L0}),4) 


(({L0} , {L0} , {L0} , {L0} , {L0} , {L0} , {L0} , {L0} , 
{L0}),2) 


(({L4} , {LO} , {L2} , {L3} , {L6} , {LO} , {L 1} , {LO} 
,{L4}),5) 


(({L0} , {L0} , {L0} , {L0} , {LO} , {LO} , {LO} , {LO} , 
{L0}),2) 


(({L4} , {L 1} , {L 1} , {L2} , {L2} , {L3} , {LO} , {L2} 
,{L0}),5) 


(({LI} , {LO} , {L3} , {L5} , {L2} , {L2} , {LO} , {LO} , 
{L0}),3) 


(({L5} , {L2} , {L 1} , {L2} , {L3} , {L2} , {LO} , {L2} 
, {L0}),6) 


(({LI} , {L 1} , {L2} , {L5} , {L 1} , {L2} , {LO} , {L 1} , 
(L0}),3) 


(({L5} , {L2} , {L 1} , {LO} , {L2} , {L3} , {LO} , {L3} 
,{L0}),6) 
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